Filipino Sign Language Recognition using Manifold Learning
نویسندگان
چکیده
Sign Language is at the core of a progressive view of deafness as a culture and of deaf people as a cultural and linguistic minority. An in-depth study of Filipino Sign Language (FSL) is crucial in understanding the Deaf communities and the social issues surrounding them. Computer-aided recognition of sign language can help bridge the gap between signers and non-signers. In this paper, we propose Isomap manifold learning for the automatic recognition of FSL signs. Video of isolated signs are converted into manifolds and compiled into a library of known FSL signs. Dynamic Time Warping (DTW) is then used to match the nearest library manifold with the query manifold for an unknown FSL sign.
منابع مشابه
Sign language and Computing in a Developing Country: A Research Roadmap for the Next Two Decades in the Philippines
This paper presents the current situation of Filipino Sign Language in the Deaf community and milestones in sign linguistics research. It highlights key computing research, particularly in Asia as well as enumerates research attempts to date of Philippine academic institutions which have applications in sign language recognition. This paper also touches on technical considerations, economic fea...
متن کاملCurve Matching from the View of Manifold for Sign Language Recognition
Sign language recognition is a challenging task due to the complex action variations and the large vocabulary set. Generally, sign language conveys meaning through multichannel information like trajectory, hand posture and facial expression simultaneously. Obviously, trajectories of sign words play an important role for sign language recognition. Although the multichannel features are helpful f...
متن کاملبهبود مدل تفکیککننده منیفلدهای غیرخطی بهمنظور بازشناسی چهره با یک تصویر از هر فرد
Manifold learning is a dimension reduction method for extracting nonlinear structures of high-dimensional data. Many methods have been introduced for this purpose. Most of these methods usually extract a global manifold for data. However, in many real-world problems, there is not only one global manifold, but also additional information about the objects is shared by a large number of manifolds...
متن کاملWeakly Supervised Metric Learning towards Signer Adaptation for Sign Language Recognition
In this paper, we introduce metric learning into Sign Language Recognition(SLR) for the first time and propose a signer adaption framework to address signer-independent SLR. For adapting the general model to the new signer, both clustering and manifold constraints are considered in the adaptive distance metric optimization. The contribution of our work mainly lies in three-folds. Firstly, a Wea...
متن کاملA Brief Review of Vision Based Hand Gesture Recognition
The evolution of user interfaces shapes the changes in Human-Computer Interaction (HCI). Direct use of hand as an input device is an attractive method for providing natural HCI. The applications of gesture recognition are manifold, ranging from sign language to medical rehabilitation to virtual reality. In this paper we present a brief review of vision based hand gesture recognition. Key-Words:...
متن کامل